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WHAT IS CLAIMED IS: 

1 . A control method of a user terminal device 
connected to a server device in a main office through a 
communication line and a home office system having a 
5 display device which is connected to said user terminal 
device, said method comprising the steps of: 

monitoring a state of a user in a place where said 
user terminal device is located; and 

judging whether or not the user has to take a rest 
10 on the basis of a monitoring result obtained in said 
monitoring step, 

requesting virtual rest space data for said server 
device if it is judged that the rest has to be taken by 
the user in said judging step; and 
15 displaying a virtual rest space on the display 

device upon receiving the virtual rest space data. 



2. A method according to Claim 1, wherein it is 
possible to communicate with other users in the virtual 
20 rest space displayed on the display device in said 
displaying step. 



3. A computer- readable storage medium which 
stores a program to cause a user terminal device 
25 connected to a server device in a main office through a 
communication line and a home office system having a 
display device which is connected to said user terminal 
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device, to execute the following steps of: 

monitoring a state of a user in a place where said 

user terminal device is located; and 

judging whether or not the user has to take a rest 
5 on the basis of a monitoring result obtained in said 

monitoring step, 

requesting virtual rest space data for said server 

device if it is judged that the rest has to be taken by 

the user in said judging step; and 
10 displaying a virtual rest space on the display 

device upon receiving the virtual rest space data. 



4. A medium according to Claim 3, wherein it is 
possible to communicate with other users in the virtual 
15 rest space displayed on the display device in said 
displaying step . 



5. A control apparatus of a virtual system which 
has plural user terminal devices and a host server 
20 device connected to said plural user terminal devices 
through a communication line and creates a virtual 
space, comprising: 

user information obtaining means for obtaining 
information of a user in a place where said each user 
25 terminal device is located; 

user state recognition means for recognizing a 
state of the user on the basis of information obtained 
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by said user information obtaining means; and 

virtual space control means for moving the user in 
the virtual space in accordance with a recognition 
result obtained by said user state recognition means. 

5 

6. An apparatus according to Claim 5, wherein 
said user information obtaining means is imaging means 
for imaging the user and said user state recognition 
means recognizes the state of the user on the basis of 

10 an image of the user outputted from said imaging means. 

7. An apparatus according to Claim 6, wherein 
said user state recognition means recognizes a face 
direction of the user and said virtual space control 

15 means moves the user to another virtual space in a case 
where the user looks toward said user terminal device 
with a predetermined number of times or for a 
predetermined time. 

20 8, An apparatus according to Claim 6, wherein 

said user state recognition means recognizes motion of 
the user and said virtual space control means moves the 
user to another virtual space in a case where the 
motion of the user is in a predetermined condition for 

25 a period longer than a previously designated time. 



9. An apparatus according to Claim 5, wherein 
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said user information obtaining means is voice sound 
information obtaining means for obtaining voice sound 
information, said user state recognition means 
recognizes emotion of the user on the basis of the 
5 voice sound information obtained by said voice sound 
information obtaining means and said virtual space 
control means moves the user to another virtual space 
in case of judging that the user is in a great stress 
condition in accordance with the recognition result 
10 obtained by said user state recognition means. 



10. An apparatus according to Claim 7, wherein 
the another virtual space is a space used for taking a 
cooperative rest. 

15 

11. An apparatus according to Claim 5, wherein 
said user terminal device has means for transmitting 
information of the user to said host server device and 
said user state recognition means provided in said 

20 server device recognizes a state of the user on the 
basis of the information transmitted from said user 
terminal device. 



12. A control method of a virtual system which 
25 has plural user terminal devices and a host server 

device connected to said plural user terminal devices 
through a communication line and creates a virtual 
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space, said method comprising: 

a user information obtaining step of obtaining 
information of a user in a place where said each user 
terminal device is located; 
5 a user state recognition step of recognizing a 

state of the user on the basis of information obtained 
in said user information obtaining step; and 

a virtual space control step of moving the user in 
the virtual space in accordance with a recognition 
10 result obtained in said user state recognition step. 

13. A method according to Claim 12, wherein said 
user information obtaining step is an imaging step of 
imaging the user and said user state recognition step 

15 recognizes the state of the user on the basis of an 
image obtained by imaging the user. 

14. A method according to Claim 13, wherein said 
user state recognition step recognizes a face direction 

20 of the user and said virtual space control step moves 
the user to another virtual space in a case where the 
user looks toward said user terminal device with a 
predetermined number of times or for a predetermined 
time. 



15. A method according to Claim 13, wherein said 
user state recognition step recognizes motion of the 
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user and said virtual space control step moves the user 
to another virtual space in a case where the motion of 
the user is in a predetermined condition for a period 
longer than a previously designated time. 

5 

16. A method according to Claim 12, wherein said 
user information obtaining step is structured by a 
voice sound information obtaining step of obtaining 
voice sound information, said user state recognition 

10 step recognizes emotion of the user on the basis of the 
voice sound information obtained in said voice sound 
information obtaining step and said virtual space 
control step moves the user to another virtual space in 
case of judging that the user is in a great stress 

15 condition in accordance with the recognition result 
obtained in said user state recognition step. 



17. A method according to Claim 14, wherein the 
another virtual space is a space used for taking a 
20 cooperative rest. 



18. A computer-readable storage medium which 
stores a program to cause a virtual system which has 
plural user terminal devices and a host server device 
25 connected to said plural user terminal devices through 
a communication line and creates a virtual space, to 
execute the following steps of: 
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a user information obtaining step of obtaining 
information of a user in a place where said each user 
terminal device is located; 

a user state recognition step of recognizing a 
state of the user on the basis of information obtained 
in said user information obtaining step; and 

a virtual space control step of moving the user in 
the virtual space in accordance with a recognition 
result obtained in said user state recognition step. 



